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ABSTRACT 


An  algorithm  for  solving  min  cost  or  max  flow  multicommodity  flow 
problems  is  described.  It  is  a  specialization  Df  the  simplex  method, 
which  takes  advantage  of  the  special  structure  of  the  multicommodity 
problem.  The  only  non-graph  or  non-additive  operations  in  a  cycle  involve 
the  inverse  of  a  working  basis,  whose  dimension  is  the  number  of  currently 
saturated  arcs.  Efficient  relations  for  updating  this  inverse  are  derived. 
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SECTION  I 


INTRODUCTION 


Multicommodity  network  flow  problems  require  the  selection  of  optimal 
flow  patterns  for  each  of  a  number  of  distinguishable  commodities  in  a 
capacitated  network.  The  objective  can  be  either  to  minimize  the  cost  of 
achieving  given  flows,  or  to  maximize  the  sum  of  the  flows.  When  a  node- 
arc  formulation  is  used,  these  problems  may  be  written  as  block  diagonal 
linear  programs  with  coupling  raws.  In  this  paper  a  compact  inverse  version 
of  the  simplex  method  for  solving  multicommodity  problems  is  described. 

By  using  the  special  structure  of  any  basis  matrix,  the  simplex  method  can 
be  performed  while  maintaining  the  inverse  of  a  working  basis  whose  dimension 
is  only  the  number  of  currently  saturated  arcs.  Aside  from  multiplication 
by  this ' inverse, all  other  simplex  computations  are  performed  using  addition 
or  graph  theoretic  operations.  The  algorithm  is  a  specialization  of  the 
generalized  upper  bounding  method  for  block  angular  problems  [4],  [5], 

It  is  similar  to  Saigal's  method  [6]  which  was  derived  using  an  arc-circuit 
formulation. 

The  approach  taken  here  has  two  important  advantages.  First  it 
presents  the  algorithm  as  a  direct  specialization  of  a  well  known  general 
procedure  for  linear  programs.  Second, in  Saigal's  work,  at  each  iteration, 
several  systems  of  linear  equations  must  be  solved  and  no  procedures  are 
given  for  updating  the  matrix  inverses  associated  with  these  equations. 

Here  we  show  that  the  only  non  graph  theoretic  or  non  additive  operations 
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required  are  multiplication  by  and  updating  of  the  working  basis 
inverse.  Hence  all  the  nonunimodular  aspects  of  the  problem  are 
condensed  into  a  single  matrix  which  appears  to  be  of  minimal  size. 
Efficient  relations  for  updating  the  working  basis  inverse  are 
derived  here  as  specializations  of  those  in  the  generalized  upper 
bounding  method. 


SECTION  II 


PROBLEM  STATEMENT 


Consider  a  network  which  has  nodes  1,  2,  N  and  directed 

arcs  a^,  a„ ,  . .  a^.  The  case  with  undirected  arcs  will 

be  considered  later.  Arcs  a^,  a^  (jf  <!  M)  have  capacities 

bl’  •••»  *-et  there  be  ^  commodities  and  define  xkm  as  the 

flow  of  commodity  k  in  arc  a  .  Each  commodity  k  has  associated 
with  it  a  source  node  s^  and  a  sink  node  tk>  The  constraints  are 

1.  flows  are  nonnegative 

xkm  >  0  (all  k  and  m)  (1) 


2.  capacity  restrictions  on  arc  a 


m 


K 

Ex.  ^  b 
.  ,  km  -  m 
k=l 


(1<  m  ) 


3.  flow  conaervatidn  for  commodity  k  at  node  n. 


E  x 

a  £B 
m  n 


km 


■  E  x 

a€A 
m  n 


km 


f-f,  if  n  =  s. 


0  if  n^sk,n^tk 


+f.  if  n  =  t. 


(2) 


(3) 


where  fk  is  the  amount  of  flow  of  commodity  k  in  the 
network,  0'  is  the  set  of  arcs  terminating  at  node  n, 
and  A^  is  the  set  of  arcs  originating  at  node  n. 
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In  the  above  linear  program  there  are  ^+1  coupling  rouia  and  K 
identical  diagonal  blocks.  The  matrix  F  ia  the  node-arc  incidence 
matrix  of  the  network  with  the  last  row  deleted.  Hence  F  is  (\l-l  x  M 
and  has  rank  IM-1.  The  variables  are  nonnegative  slacks  for  the 

capacity  constraints,  and  the  vector  d^  has  -f^  in  position  sk, 
+fk  in  position  t  and  zeroes  elsewhere. 


SECTION  III 


THE  GENERALIZED  UPPER  BOUNDING  ALGORITHM 
FOR  BLOCH  ANGULAR  PROBLEMS 


Consider  the  general  block  diagonal  problem  with  coupling  rowB. 


minimize  Z 

Subject  to  Agxg  +  A^x^  +  .  .  .  +  A^x^  =  b 


°ixi 


=  b. 


DKXK  ~  bK 


xA  .>  0 


l 

1 

l 

r 


where  each  A.  is  an  m  x  n,  matrix,  each  D.  is  m.  x  n.,  and 
i  o  i  ill 

Z  is  the  first  component  of  x^.  Lie  assume  throughout  that  the 
constraint  matrix  of  (7)  has  full  rank.  Hence  each  D^  has  rank 
m^.  The  method  is  based  on  the  following  result  proved  in  [5], 

Theorem  1  Any  basis  matrix  B  for  (7)  can  partitioned  to  have 
the  form: 
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(7) 
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Using  the  fact  that  the  are  ncnaingular  we  develop  a  trans¬ 

formation  matrix  V  such  that  B  T  is  block  triangular.  The  simplest 
such  I  has  the  form 

.g  rows 

(9) 

where  I^vand  are  identity  matrices  and 


(10) 
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tti-q  columns 


Then 


B  T  = 


ro.g  rous 


(11) 


is  the  black  triangularized  basis  matrix.  The  submatrix  B,  given  by 


B  =  £  +  [Au  A21  ...  AH1  ]  V  (12) 

is  called  the  working  basis.  Since  T_  is  nonsingular,  B  is 
also  nonsingular. 


We  now  examine  haw  the  operations  of  the  revised  simplex  method 
may  be  carried  out  using  quantitites  associated  with  the  uorking  basis. 
These  operations  require  only  that  two  sets  of  linear  equations,  with 
coefficient  matrices  B'  and  B,  be  solved  (one  for  the  pricing  vector, 
the  other  fur  the  transform  of  the  entering  vector).  Triangularizing 
B  greatly  simplifies  their  solution. 

Determining  the  Simplex  Multipliers.  Here  the  vector  of  simplex 
multipliers  ^  ~  (ng,  ^ ,  ...,  tt^)  is  to  be  computed.  These  satisfy 

nI=  CB 

or,  since  only  Z  has  a  nonzero  objective  coefficient,  and  its  column 
is  the  leftmost  column  of  B, 


tt  B  =  (1,  0,  ..., 


0) 


(13) 
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Multiplying  on  the  right  by  _T, 


n(B  T)  =  (1,  0,  0)  T  =  (1,  □ . 0) 


Since  8  I  is  triangular,  these  are  easily  solved  yielding 


77  p  =  first  rou  of  B" 


"i  -  -"o  fln  ai' 


(1  =  1 . H) 


Thus  if  B"^  and  B“^  are  maintained,  the  vectors  n  and 


n  .  are  easily  computed. 


Determining  the  Column  to  Enter  thB  Basis.  ThiB  iB  done  as  in 


the  revised  simplex  method  by  computing 


CJ 


for  each  nonbaBic  column  P^.  Note  that  only  2  partitions  of  any 
column  Pj  are  nonzero.  If 

mir.  c .  =  c  >0 
J  s  ~ 


then  the  current  solution  is  optimal.  Otherwise  enters  the 

basis.  Suppose  P  is  a  column  from  the  <r^h  block  so  that 

— a 

p  =  EP_n,  D  ...  0,  P  ,  0  ...  0]: 

—s  su  Scr 
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I 

I 


Finding  "P  =  B'1  P 

a  «  —  — c 


Here  we  must  solx/e  the  linear  system 


B  ^  =  P 

- s  — s 


(18) 


Let  ^  =  IZ  (19) 

Substituting  (19)  into  (18)  gives 


(BpZrP g  CO ) 

which  can  be  easily  salved  far  Z  =  (ZQ,  Z^ . Z^Y  since  ,0  T 

is  black  triangulai; 


Z. 

l 


=  □ 


i  =  1,  . . . »  K  ;  i  ^  cr 


Tn.s  Zq-  and  ZQ  can  be  campcCed  if  B_1  and  B^1  aie  known. 
A  A  A  A 

Pg  -  ,p3o?  psl  •••)  pgM)  -^mP^Led  ^rcm  (19)  giving 


Cl) 


(c ) 

C  3) 


Z 


0 


\y. 

i 


i  =  1  . . . ,  K ;  i  ^  a- 


A 

P 

s<r 


Z 

0 


+ 


Z 


cr 


whexe  l /„ 

i 


is  the 


t  h 

partitio-  of  U. 


(  U) 


C.3) 

Cr ) 
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Choosing  the  Column  to  leave  the  Basis.  This  is  done  according  to 
the  standard  simplex  formulas.  If  ths  solution  is  not  unbounded,  then 
column  r  of  JB  ,  JP .  leaves  the  basiB.  Assume  that  thiB  column  is 

J  r 
"t  h 

from  the  j>  block  of  (7).  Since  computing  the  new  values  of  the  basic 
variables  also  proceeds  as  in  the  revised  simplex  method,  we  now  consider 
updating  the  matrices  B”^,  B7^  and  any  other  quantities  needed  for  the 
next  iteration. 


Updating  Formulas.  There  are  two  cases  which  can  occur.  Only  the 
results  are  stated  here;  derivations  may  be  found  in  [5], 

Case  1  The  leaving  column,  Is  ron-key^  Here  the  entering  column,  can 
directly  replace  the  one  leaving  without  destroying  the  block  diagonal 
structure  of  B_.  Then  rone  of  the  B71  change,  and  B-^  is  trans¬ 
formed  to  *B_1  by  a  pivot  operation. 

*B-1  =  E  B-1 


where  E 
except  i:~ 
columf'  r 


is  an 
co  1  jm  n 
of  E 


m^  x  mQ  elementary  column  matrix  egual  to  the 
r.  Let  i.  be  the  i^h  component  of  ^  . 

X  S  Q 

has  components 


iderti: v 


Then 


7 


l 


l  —  1,  ...,  mQ ,  i  ^  r 
i  =  r 


C.7) 
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Case  2  The  leaving  column  is  a  key  column.  Here  when  column 
P,  leaves  the  basis,  the  block  Bp  will  have  only  mp  -  1  columns. 

Jr  '  r 

He" :e  it  is  necessary  to  find  another  basic  column  from  the 
block  to  restore  the  basis  structure.  There  are  two  subcases. 


Case  2a  There  may  be  a  basic  ron-key  column  from  the 

block  which  ca~  be  interchanged  with  £.  i.n  the  basis.  The-1  the 

Jr 

leaving  column  P.  will  became  non-key  and  Case  1  can  be  applied. 

Jr 

*  t  h 

Suppose  £.  is  the  i?  key  column  in  the  basis  and  that  it  will 

JT'  ^ 

1  "t  h 

change  places  with  the  non-key  column.  Then  the  working  basis 

is  updated  by 

♦B*1  =  E  B"1 


where  E  a  a  an  mQ  x  mQ  elementary  row  matrix  equal  to  the  identity 

except  in  the  i^h  row.  Row  of  E  is  just  the  a^1"1  row  of 

the  submatrix  \l  in  the  transforming  matrix  T_  in  (9).  There  is  a 

non-key  column  which  can  be  exchanged  with  P.  if  ar.d  only  if  there 

-1  Jr 

is  a  nonzero  elemert  an  this  row.  B_  Uill  change  by  a  sample  pivot , 
-1 

and  all  other  B^  will  remain  unchanged. 


Case  2b  If  Case  2.a  cannot  be  performed,  the7"  by  Theorem  1,  the 

t  h 

e  t eiin.g  column  £s  must  be  from  the  j>  block  and  a  direct  pivot 
is  possible.  In  this  case  B^  changes  by  a  simple  pivot,  and  the 
working  basis  will  not  change  at  all. 


13 


This  completes  the  description  of  the  algorithm  for  the  general 
■rase.  Meta  t->at  at  each  iteration  it  is  necessary  to  update  at  most 
art  mQ  x  mQ  working  basis  inverse  and  an  rru  x  rrn  diagonal  block 
inverse.  All  updates  ran  be  performed  using  multiplication  by  an 
elemer'ary  row  or  column  matrix. 


SECTION  II / 


WORKING  BASIS  STRUCTURE  FOR  THE  MULTICOMMODITY  PROBLEM 

In  the  fallowing  sections  the  generalized  upper  bounding  algorithm 
is  applied  to  the  multicommodity  problem.  Because  of  the  special 
structure,  significant  simplifications  occur. 

Consider  any  basiB  matrix  B  for  the  multicommodity  problem  (6). 
By  Theorem  1  the  basis  matrix  can  be  partitioned  as  follows 


S  +  i  yf-S 

columns  columns 


+1  rows 


(£8) 
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In  this  basis  there  are  s  saturated  arcs,  and  hence  -  s  slack 
variables  in  the  basis.  For  each  of  the  K  commodities  there  is  a 
diagonal  block  EL  which,  by  Theorem  1,  is  an  N-l  x  N-l  noneihgular 
submatrix  of  the  node  arc  incidence  matrix  F.  The  remaining  s+1 
columns  in  [R^  R n  R-^J '  consist  nf  the  cost  variable  (which  is  always 
the  first  basic  variable)  and  s  columns  which  are  excess  columns  from 
some  of  the  commodity  blocks. 

It.  is  well  known  that  the  l\l— 1  arcs  corresponding  to  the  columns 
of  each  matrix  EL  form  a  spanning  tree  in  the  network  [2],  Consequently 
we  will  be  able  to  perform  all  the  simplex  operations  which  require 
B~^  by  graph  theoretic  means,  so  it  is  not  necessary  to  maintain  these 
inverses  (or  the  matrices  B^)  explicitly. 

The  only  portions  of  the  algorithm  which  are  not  "graph  theoretic" 
involve  multiplication  by  the  working  basis  inverse,  so  we  now  consider 
■the  structure  of  the  working  basis.  It  .arises  from  the  submatrix 


R1 

0 

Ro 

I 

of  B^  in  (20)  when  £  is  triangularized  by  driving  R^  to  zero. 
Suppose  P  is  GP.e  of  the  s  excess  columns  in  [R^  R^  R^]7  of  the 
basis,  and  that  it  is  from  the  k^*"1  commodity  block,  so 
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P  =  (Pg,  0  ...  0,  Pk,  0  ...0)' 

a  and  Pk  has  l\l-l.  The 
corresponding  column  in  the  working  basis  will  then  be  given  by 


where  Pg  has  Jl  +  1  component 


A.  . 

kl  k  k 


(29) 


(see  (12)).  Here  Pk  is  a  column  of  F  not  contained  in  B^, 
so  it  corresponds  to  an  out-of-tree  arc  for  the  k^1"1  commodity. 

Any  such  cut-ofrtrge,  arc  forms  a  unique  circuit  with  the  arcs 

of  the  spanning  tree,  and  this  circuit  is  described  by  the  vector 
-  B~  P^  whose  j  component  is  [  1  ] 

+1  if  the  tree  arc  corresponding  to  the  jth  column  of  Bk 

is  in  the  circuit  and  oriented  the  same  as  the  out  of  tree  arc. 

4“  h 

-1  if  the  tree  arc  corresponding  to  the  j  column  of  Bk  is 

in  the  circuit  and  oriented  in  the  opposite  direction  as  the 
out  of  tree  arc. 

□  if  the  tree  arc  corresponding  to  the  column  Df  B.  is 

net  in  the  circuit. 

Hence  the  vector  -  B~^  Pk  can  be  calculated  without  knowing  B"1 
by  a  simple  labeling  process  in  the  network: 


(a)  Label  the  destination  node  of  the  cut-of-tree  arc  with 
the  label  +0.  Go  to  Step  b. 
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(b)  Take  some  node  n  which  has  been  labeled  but  not  scanned 
and  scar,  it.  This  means  that  every  unlabeled  node  which 

is  corrected  to  node  n  by  a  trt  e  arc  (in  the  k^h  spanning 

tree)  is  given  a  label.  If  the  new  node  is  reached  by 

moving  forward  on  arc  a  ,  then  the  new  node  iB  labeled  +m. 

m 

If  the  new  node  is  reached  by  moving  backward  on  arc  a  , 

m 

then  the  r.ew  node  is  labeled  -m.  Go  to  Step  c. 

(c)  If  the  origin  rode  of  the  out-of-tree  arc  has  been 
labeled,  go  to  Step  d.  Otherwise  go  to  Step  b. 

(d)  Backtrack  through  the  tree  until  the  +□  label  is  found, 
recording  the  vector  -B"1  Pk  as  the  backtracking  is 
performed. 


la 


The  submatrix  A^  in  (29)  has  columns  which  contain  a  cost 
coefficient  as  the  first  component,  and  either  zeroes  or  a  unit 
vector  as  the  remaining  components.  Essentially  this  matrix  per- 
mates  the  arcs  of  the  tree  into  the  order  in  which  they  appear 
in  the  capacity  constraints.  Because  B“^  Pk  is  all  0  or  +1, 
no  multiplications  are  required  to  compute  B"1  and  hence 

in  (29)  is  readily  computed.  This  column  r  Qg  of  the  working 

basis  can  be  interpreted  as  fallows.  For  i  =  1 . X  let  the 

i^h  capacitated  arc  be  the  one  corresponding  to  the  i+l^  row 
of  B.  Then 

a)  The  first  component  of  Qg  is  the  sum  of  the  cost 
coefficients  of  arcs  in  the  circuit  for  £,  with  a 
plus  sign  far  arcs  oriented  as  £f  s  arc  and  minus 
otherwise. 

b)  The  remaining  components  are  all  zero  or  +  ones  with  the 

t  h 

i+1  component  being 

+1  if  the  i^h  capacitated  arc  is  the  arc  associated  with 
the  column  £  . 

+1  if  the  ith  capacitated  arc  is  in  the  unique 
circuit  formed  in  the  tree  by  the  addition  of  P 
and  oriented  the  same  as  P. 

-1  if  the  i^1"1  capacitated  arc  is  in  the  unique  circuit 
formed  in  the  tree  by  the  addition  of  P,  but  oriented 
opposite  to  £. 

□  otherwise. 

As  a  result  Df  this  interpretation,  Qg  can  be  computed  by  a  simple 
extension  of  the  labeling  algorithm  far  finding  circuits. 
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The  slack  columns  In  the  original  basis  are  not  affected  by  the 
triar.gularization.  Hence  the  working  baeia  B  win  have  the  form 


S1  0 


SJ  1 


s+l  J-l 


where  the  columns  of 


Sn  have  the  form  of  in  (29). 


The  algorithm  presented  in  Section  111  involves  the  inverse  of  B 
in  several  pieces.  In  general,  the  elements  of  B'1  are  hot  integers, 
and  it  is  necessary  to  maintain  S'1  explicitly.  The  presence  of  the 
slack  columns  lets  us  write 


and  we  win  maintain  only  s'1  explicitly.  Rowe  of  -S^1  are 

just  .linear  combinations  of  rows  of  S’1  with  coefficients  +1, 

so  they  are  easily  obtainable  from  s’1  wherever  needed. 
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* 

—  The  result,  then,  of  the  special  structure  of  the  multicommodity 

^  problem  is  that  it  suffices  to  maintain  and  update  a  submatrix, 

|  S"1,  of  the  working  basis  inverse.  The  dimension  of  S”^  is 

s+1 ,  where  there  are  s  saturated  arcs  in  the  current  basis  B. 

\  Thus,  considerable  savings  are  obtained  whenever  the  number  of 

saturated  arcs  is  small  relative  to  the  total  number  of  capacitated 
1  arcs.  All  other  computations  are  performed  by  graph  theoretic  means. 

I 

l 

1 

1 

I 

I 

l 


SECTION  V 


THE  ALGORITHM  FOR  THF  MULTICOMMODITY  PROBLEM 

Assume  that  at  the  beginning  of  some  simplex  iteration  the 
following  quantities  are  known: 

1.  The  Submatrix  S”1  of  B-^  in  (31) 

2.  The  values  and  indices  of  the  basic  variables 

3.  The  spanning  tree  for  each  commodity 

In  addition  it  may  be  desirable  to  maintain  the  submatrix  V  of 
J_  in  (9)  ar.d  the  submatrix  S^  of  B  in  (30)  (see  Section  VI 
for  further  discussion).  The  simplex  iteration  proceeds  as  follows. 


Determining  the  simplex  multipliers.  By  (15)  the  multipliers  ttq 
for  the  capacity  constraints  are  found  in  the  first  row  of  B~*. 
Referring  to  (31)  multipliers  for  saturated  arcs  are  found  in  the 
first  row  of  S~^  and  multipliers  for  unsaturated  arcs  are  zero. 
Uncapacitated  arcs  can  be  assigned  a  multiplier  of  zero.  The  vector 
t  ^  contains  multipliers  for  the  rows  intersecting  the  k^*1  commodity 
block.  By  (IS)  these  satisfy 


T7 

k 


(32) 
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The  vector  7,1  has  □  i  „„  . , 

0  8  flrSt  CDmP°nGnt,  and  tha  first  rou 

°th  kl  contalnB  thB  negativeB  gf  ‘he  coeffictents  for  the  eras  in  tha 

k  tree.  Hence  for  1 <  i  <  N  _  x  th  .th 

n  ~  ne  1  component  of 

-  0  \l  1=  tha  cost  coefficient  of  tha  !<*  arc  Qf  ^  kth  ^ 

minus  the  component  of  cnrrpsnrmH- 

o  e spanning  to  this  arc*.  ue  yin  call 

this  the  price,  p,1,  0f  thB  4th 

Hk.  or  tne  1  tree  arc.  Since  q  4  *  *  . 

. .  ce  ak  JS  triangular, 

equations  C32)  can  Pe  solved  by  successive  agination.  In  giaph 
theoretic  terms  the  procedure  is: 


1. 

2. 


this  node  has^heen^droppe^from  F)  CthB  equation  f°r 

Suppose  the  multiplier  -r  ^  for  node  n,  has  bean 
Bvaluatad  and  ^  ia  connected  to  n,  Jy  m  arc  a 
in  the  tree  with  price  p1  tl._  2  ai 


k-  * 


Then 


nr 


n 


_  n 


n. 


n  n2  n  ni 

k  =  k 


Pk  if  the  arc  is  oriented  ^ 


-  Pk  if  the  arc  is  oxientBd  _ 

2  f  ni 


^ntir.ue  branching  alc-'a  the  vth  4- 

have  been  assigned  multipliers  for  ihl*  KhU  311  ncdes 

e  K  commodity. 


Strictly  speaking,  uncapacitated  arcs  have  nn 
""  -  -  an  arc  is  tint  be 


n 

O' 
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Determining  the  column  to  enter  the  basis.  Let  c,  be  the 
- a -  j<nri 

relative  cost  factor  for  x^.  Referring  to  (6),  has  at  most 

four  non-zero  terms: 


ckm 


c.  -  tt 
km  Oj 


+  tt. 


m 


where 

n,  is  the  origin  node  of  arc  a 
1  m 

r.r,  is  the  destination  node  of  arc  a 

m 

and 

tt  is  the  component  of  ttq  corresponding  to  arc  a  if 
Jm 

the  arc  is  capacitated  and  zero  otherwise. 

The  slack  variable  has  relative  cost  factor  -  ttq^. 

Suppose  column  =  [PsQ,  0  ...  0>  Ps(<)  0  ...  DU  *  from  the 
kth  commodity  block  is  chosen  to  enter  the  basis,  (k  =  □  implies 

P  is  a  slack  column). 

— s 


A  _  1 

Finding  P  =  B_  P  The  transformation  of  the  entering  column 
Ps  in  terms  of  the  current  basis  is  outlined  in  equations  (21)  -  (26). 
In  terms  of  the  multicommodity  problem  these  steps  became 


2i  * D 

2k  =  BkX  Psk 


i  —  1  j  •  •  •  7  ^ 


i  *  k 


20  =  8-1  (PS0  -  \l  V  -  B_1  3S0 


Note  tnat  Z,  is  just  the  -negative  of  a  circuit  vector  and  Q  is 

K  Su 

a  tclum-  like  in  (29). 


Hence  both  and  Q^g  can  be  computed  uaing  the  graph  theoretic 

labeling  procesa  deacribed  in  Section  II/.  To  obtain  ZQ  it  ia 
neceasary  to  multiply  by  B"1,  a  non-graph  operation;  The  detaila 
of  the  computation  are: 


ao  a  matrix  multiplication  of  order  8+1  muat  be  performed  to  get 
QsQ  .  Then  the  reat  of  the  column  ia  generated  by  additive 
operationa,  since  Sr,  is  a  matrix  of  zeros  and  +  l's. 

A 

Transforming  back  to  P  is  accomplished  as  in  (24)  -  (26)  by 

1 S  7 


Here  \J i  is  an  N-l  x  £+ 1  matrix  which  is  all  zero  except  in 
columns  corresponding  to  excess  columns  from  commodity  block  i. 


w 


■ 
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The  nonzero  columns  oonteln  the  circuit  vectors  for  those  excess 
columns  (see  (10)).  Thus  this  trensformstlon  from  Z  to  P 
is  else  accomplished  using  only  additive  operations.  If  the  entering 
column  is  a  slack  column,  then  the  computations  are  even  simpler  - 
all  Zj  are  zero  (i  /  0),  and  ZQ  is  Just  a  column  of  B'1. 

Chocsing  the  Column  to  leave  the  Basis  Thia  lB  done  accordlng  tQ 

the  standard  simplex  formulas.  Assume  that  column  r  of  B  leaves 

the  basis.  Since  computing  the  new  values  of  the  baeic  variables 

also  proceeds  as  in  the  standard  simplex  method,  Lie  not,  consider  up- 
dating  the  submatrix  S"1. 


SECTION  VI 


UPDATING  FORMULAS 


In  previous  sections,  we  have  maintained  only  a  submatrix  S~* 
of  B-^.  All  other  quantitites  are  calculated  as  needed  by  graph 
theoretic  and  additive  methods.  Hence,  in  the  updating  procedures 
for  B-^,  it  suffices  to  consider  updating  only  S~^.  The  cases 
are  the  same  as  in  Section  III. 


Case  1 


When  the  leaving  column  is  non-key,  B 


is  updated 


by 


(33) 


uhere  E  is  an  elementary  column  matrix.  Since  none  of  the  diagonal 
blacks  are  affected,  the  spanning  trees  are  unchanged.  There  are 
A  subcases: 

a)  The  leaving  column  is  a  flow  column,  and  the  entering 
column  is  a  flow  column. 

b)  The  leaving  column  is  a  flow  column,  and  the  entering 
column  is  a  slack  column. 

c)  The  leaving  column  is  a  slack  column,  and  the  entering 
column  is  a  flow  column. 

d)  The  leaving  column  is  a  slack  column,  and  the  entering 
column  is  a  slack  column. 

Consider  first  Pases  la  and  lb  in  which  the  leaving  column 
is  a  flow  column.  Then,  writing  (33)  in  partitioned  form  gives 


C-  3 


s;1 

□ 

-S2S l 1 

I 

♦S^1  0 


-‘VSI  I 


where 


* ,  Sl 


Hence  is  updated  by  an  elementary  column  matrix. 


If  the  entering  column  is  a  flew  column,  then  the  updating 

is  complete.  If  the  entering  column  is  a  slack  column,  then 

S"1  can  be  reduced  in  dimension  by  cne,  since  *S“1  in  (’4)  will 

contain  a  unit  vector  column.  To  see  this,  suppose  that  the  leaving 

column  is  in  position  r  in  the  basis  Cr  <  s+1)  and  that  the  slack 

in  row  t  (t  <  s+1)  is  entering.  As  shewn  in  Section  1 /  the  first 

t  h 

I+l  components  cf  the  transformed  entering  column  are  the  t 
column  of  B-1.  Updating  the  working  basis  is  accomplished  by 
pivoting  on  the  element  c*-  this  column,  as  illustrated  below; 


□  4—  r 

(pivot) 

element 


0 

-s2s;1 

i 

:c  1  umn  t 


Pivot  column  is 
column  t  of 
o"l 
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Since  the  pivot  reduces  the  pivot  column  to  a  unit  vector,  it  will  also 
reduce  column  t  of  B-^  to  the  r^  unit  vector.  Consequently  we  car- 
reduce  the  dimension  of  by  dropping  its  tth  column  and  rth  row. 

In  Cases  lc  and  Id,  the  leaving  column  is  a  slack  column  in 
position  r  in  the  basis  (r>s  +  1),  so  (33)  becomes 


,-l 


,-l 


*s:1 


s;1 

0 

-Vi1 

I 

i  - 


i  - 


.  th 


8+1 


Sn  >  S 


-1 


.-1 


t 


col urn: 
x 


where  v  is  the  r-s-i  row  of  Sr.  As  seen  from  (35),  the  block 
triangular  structure  of  B’"^  has  been  destroyed  by  the  presence  of  the 
eta  column.  If  the  entering  column  is  the  slack  in  row  t,  (Case  Id) 
then  just  as  in  Case  lb,  column  t  of  ♦B"'1'  will  contai  *  the  rth 


unit  vector.  The  structure  can  then  be  restored  by  exchanging  the 
r^1"1  and  t^h  columns  of  *B"^.  This  corresponds  to  replacing  coi 
t  of  ^S”1  (which  is  a  zero  column)  with  t^e  colum"  v^. 


(35: 


(3 
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Finally,  if  the  entering  column  is  a  flow  column  (Cass  lc), 
*S”1  must  increase  in  size  by  one  sines  there  is  one  less  slack 
in  the  basis.  To  preserve  the  structure  of  *B”^,  the  r^^1  column 
and  raw  are  moved  to  position  s+2.  Then  *S^  is  augmented  by  a 
border 


•s;1 

ui 

where  f.  is  the  r-s-l^  element  of  xj>2  and  u  1b  the  r-B-1^ 
'  1 

row  of  -*S2  *S1  .  To  compute  w  notB  from  (35)  that 


Hence  its  r-s-l^h 


row  is 


S2  S"1  =  -y  S'1  (37) 

where,  as  in  (36),  v  is  the  r-s-lth  row  of  S^.  If  the  calculations 
in  (36)  are  carried  out  from  right  to  left (as  is  clearly  preferable), 
vS"*  will  already  have  been  computed. 
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Case  2  When  the  leaving  column  ia  a  key  column,  the  corresponding 
arc  is  an  arc  in  one  of  the  spanning  trees  (say  for  commodity  k).  Re¬ 
moving  it  from  the  basis  will  destroy  this  tree,  so  the  k^h  spanning 
tree  must  be  redefined.  As  in  Case  2a  of  Section  III,  Lie  first  attempt 
to  exchange  the  leaving  column  with  a  basic  non-key  column  from  block  k. 
Consider  the  baBic  non-key  columns  from  block  k.  Ths  arc  corresponding 
to  each  of  these  induces  a  unique  circuit  in  the  kth  tree.  If  one  of 
these  circuits  contains  the  leaving  column,  then  adding  that  arc  to  the 
tree  and  removing  the  leaving  column  will  leave  us  with  a  new  spanning  tree. 
As  in  Section  III,  the  working  basis  is  then  updated  by  an  elementary  row 
matrix, 


V 

1 

1 

1 

1 

1 

1 

(38) 


The  vector  v  is  a  row  of  the  submatrix  V  in  (10).  It  contains  zeroes 
except  for  +1  in  columns  corresponding  to  bxcbbb  columns  from  block  k 
whose  circuits  involve  the  leaving  column.  Hence,  in  particular,  v  is 
zero  in  the  last  Jl- s  columns,  the  slack  columns.  Hence,  in  partitioned 
form  (38)  is 


0 

“1 

\ 

0 

I 
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where  v^  contains  the  first  s+1  components  of  v.  Then 


gives  the  updating  relation  for  *S“^.  Note  that  only  one  row  of 
S"1  changes,  and  that  row  becomes  a  linear  combination  of  towb  of 
S"1  with  coefficients  D,  +  1.  Hence  no  multiplication  iB  required 
for  this  update. 

If  no  such  exchange  is  possible,  then,  as  in  Case  2b  of  Section 
III,  a  direct  pivot  can  be  performed.  A  single  spanning  trBeils  -rede¬ 
fined  (one  arc  changes).  There  is  no  change  in  the  working  basis  and 
hence  no  change  in  S“*. 

In  each  case,  in  addition  to  updating  S"1  and  one  of  the  K 
spanning  trees,  we  may  wish  to  update  the  submatrices  \J  and  S^. 

Each  column  of  V  contains  at  mast  one  nonzero  partition,  and  that 
partition  is  a  circuit  vector  of  the  form  -B"1  Pk. 

When  a  non-key  column  leaves  the  basis,  (Case  1),  one  column  of 
\l  will  change  and  a  new  circuit  vector  must  be  computed.  When  a 
key  column  leaves,  a  spanning  tree  (say  the  k^*1  tree)  changes,  bo  all 
circuit  vectors  in  must  be  recomputed.  Since  at  most  two  partitions 

of  V  are  changed  at  any  iteration,  it  may  be  desirable  to  store  the 
nonzero  columns  of  V k  explicitly.  Since  these  contain  only  zeroes 
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l 

I 

I 

l 


and  +  ones,  they  can  be  stored  compactly.  The  alternative  iB  to 
recompute  them  at  each  cyclB.  The  best  course  of  action  depends  on 
the  amount  of  high  speed  storage  available. 

The  matrix  is  a  submatrix  of  B,  and  as  shown  in  (29)  B 

has  columns  of  the  form 

«□  =  P0  -  Akl  Bk  Pk 

As  shown  in  Section  IV,  is  essentially  a  permutation  of  the  circuit 
vector  -B”^  P^.  Hence  probably  should  not  be  stored  explicitly; 

it  is  easily  generated  as  needed  from  the  columns  of  V. 
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SECT  IOI\i  V II 


MAX  FLOW  PROBLEMS  AND  UNDIRECTED  ARCS 


To  solve  the  max  flow  problem,  a  column  for  the  commodity  flow 
variable  fk  must  be  added  to  the  k*^  block.  This  column  corresponds 
to  a  fictitious  arc  from  the  sink  t^  to  the  source  s^  for  commodity 
k.  The  right  hard  side  vectors  dk  in  (6)  are  all  zero,  and  the  cost 
coefficients  are  unity  for  the  fk  and  zeroes  otherwise.  Aside  from 
the  change  from  minimization  to  maximization,  the  algorithm  proceeds 
as  before. 


As  shown  in  [  3  ]  problems  with  undirected  arcB  can  be  formulated 
by  defining  new  variables  y^  and  yk”m  satisfying 


km 


=  y 


km 


'km 


vk;  >  °- 


Vk'm  >  0 


Then  the  capacity  constraint 


E 

k 


b 


m 


becomes 


E  (y. 

.  ykm 
k 


m 
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provided  that 


(39) 


If  the  problem  has  an  optimal  solution,  then  it  has  a  solution  in  which 
(39)  is  satisfied.  The  constraint  matrix  then  takes  the  form 


The  algorithm  described  above  can  be  applied  directly  to  this  case. 
The  structure  of  the  working  basis  is  exactly  the  same.  The  only 
change  is  that  the  extra  columns  must  be  considered  in  the  pricing 
operation.' 
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